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Abstract. We consider a class of self-interacting random walks in deterministic or 
random environments, known as excited random walks or cookie walks, on the d- 
00 , dimensional integer lattice. The main purpose of this paper is two- fold: to give a survey 

of known results and some of the methods and to present several new results. The 
latter include functional limit theorems for transient one-dimensional excited random 
walks in bounded i.i.d. cookie environments as well as some zero-one laws. Several 
open problems are stated. 
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1. Model description 



^Sj I Random walks (RWs) and their scaling limits are probably the most widely known 

■ and frequently used stochastic processes in probability theory, mathematical physics, 

I and applications. Studies of a RW in a random medium are an attempt to understand 

QQ ' which macroscopic effects can be seen and modeled by subjecting the RWs dynamics 

on a microscopic level to various kinds of noise, for example, allowing it to interact with 
T^lj- I a random environment or its own history (through path restrictions, reinforcement, 

O ■ excitation etc.). 

The Markov, or memory-less, property of simple RWs lies at the heart of the classical 
approach to these and much more general processes. But it also imposes a restriction 
on the applicability of such models, as many real life processes certainly have memory. 
^ I Over the last decades several types of non-markovian RWs appeared in the literature 

and became active areas of research; for example, self-avoiding RWs, edge or vertex 
reinforced RWs, and excited RWs (ERWs), also known as "cookie walks" □ The reader 
interested in the first two types of models is referred to the surveys |T6th99j and [Pem07| . 
At the time when |Pem07j was written, ERWs had just appeared and for this reason 
were only briefly mentioned |Pem07[ p. 51]. 

The main purpose of this article is two-fold. First, we give a survey of results and 
some of the methods concerning ERWs. Second, we include several new theorems, see 
e.g. Theorems 12.51 13.161 16.61 and 16.71 We also state several open problems. While 
we aim at presenting all major results known for ERWs on 7j'^,d > 1, the choice of 
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methods explained in some detail has been influenced by our personal preferences and 
contributions to this area. 

Primarily, we shall be concerned with discrete time ERWs on Z*^, d> 1, even though 
the construction can be readily extended to other graphs (see |Voin3[ iGMPOS l. 'BS09] for 
trees, [ZerOGllDolll] for strips) or continuous time-space processes (see |RS11. RSJ for so- 
called excited Brownian motion). Broadly speaking, one considers a certain underlying 
and presumably well-understood process and modifies its dynamics for the first few visits 
to each site. These modifications can be thought of as stacks of cookies placed on each 
site of the lattice. Each cookie encodes a probability distribution on Z'^. The walker 
consumes a cookie at his current location and makes a move according to the distribution 
prescribed by that cookie. Upon reaching a site where all cookies have already been eaten 
or were not there to begin with, the walker makes a move in accordance with the original 
underlying dynamics. Below we consider processes whose underlying dynamics is the 
simple symmetric RW and for which the cookie stacks are random themselves (i.i.d. or 
stationary and ergodic) and induce transitions between nearest neighbors. (For a model 
with cookies inducing (long-range) non-nearest neighbor transitions see [RSlOj .) 

We start with the description of a relatively general model which allows infinite cookie 
stacks. Let £ := {±ej | j € {1,2,... ,d}} be the set of unit coordinate vectors in Z'^ 
and denote by Ms the set of probability measures on £, i.e. vectors with 2d non- 
negative entries which sum up to 1. Such vectors are called cookies. The set of cookie 
environments is denoted by 

(Here N = {1, 2 . . .}.) The elements of 17 are written as a; = {uj{z, e, i))z^z'' ees igN with 
{lo{z, e, i))e££ being the i-th cookie at z. It is consumed by the walker upon the i-th visit 
to z, if there is such a visit, and provides the walker with the transition probabilities 
from 2: to z + e in the next step. More precisely, for fixed a; G 17 and x S Z*^ an ERW 
starting at x in the environment a; is a process X := (X„)„>o on a suitable probability 
space {Vl' ,Px,uj) which satisfies 



Px,io[Xn+l= Xn + e\ {Xi)Q<i<n] = w (X„ , 6, #{z G {0, 1 , . . . , n} | = 

for all n G No = N U {0} and e G Here denotes the cardinality of the set A. 

The cookie environment oj may be chosen at random itself according to a probability 
measure P on (17,7^), where J- is the canonical product Borel u-algebra. Averaging the 
so-called quenched measure Px,uj over the environment uj we obtain the averaged (often 
also called annealed) measure Px[-] '■= '^[Px,ljj[']\ on 11 x H'. The expectation operators 
corresponding to Px^u)-,^-, and Px are denoted by Ex^u)-,"^-, and Ex., respectively. 

A common assumption about P will be: 

(IID) the family (a;(z, •, ■))z£i'i of cookie stacks is i.i.d. under P. 

A weaker condition is: 





1 and 



(SE) 



the family (a;(z, •, •))xgz<' is under P stationary 
and ergodic_^ with respect to the shifts on Z*^. 



'i.e. every A £ which is invariant under all shifts on Z satisfies T[A\ £ {0, 1}. 
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To escape degenerate situations we shall often assume one of the following ellipticity 
conditions, called weak ellipticity, ellipticity, and uniform ellipticity. 

(WEL) For aU z€Z'^,e€£: P [Vi G N : uj{z, e, i) > 0] > 0. 

(EL) For all z G Z'', e G f and i G N : P-a.s. u{z, e, i) > 0. 

(UEL) There is k > such that for all z £ Z'^,e e £ and i G N : P-a.s. a;(z, e, i) > k. 

Obviously, (UEL) ^ (EL) ^ (WEL). 

If a; G is such that uj{z,e,i) does not depend on z, e, and i then necessarily 
uj{z, e, i) = l/(2(i) and hence X is, under Px,uj, the simple symmetric RW on Z'^ starting 
at X. Since the consumption of a cookie (u;(z, e, i))e^s = (l/(2(i))eG£: does not change the 
dynamics of the simple symmetric RW, which is our underlying process, such a cookie 
will be called a placebo cookie. 

If we allow dependence of a;(z,e, i) on e but neither on z nor i we obtain all nearest 
neighbor random walks on starting at x whose increments are i.i.d.. 

If we let u]{z, e, i) depend on e and z but still not on i then we get all nearest neighbor 
Markov chains on lA. Choosing a; G at random (assuming usually (IID) or (SE)) 
yields all nearest neighbor RWs in random environments (RWRE) on Z'^, see e.g. |Zei041 
ISzn04| . (However, note that although RWRE can be thought of as a special case of ERW, 
the present paper does not attempt to survey RWRE results.) 

All these processes are markovian. However, as soon as u}{z,e,i) starts depending 
on i, X loses the Markov property. The walker's behavior may depend on the number 
of visits to his current location. Such class of processes seems to be too general to be 
considered in a coherent way and might not be related anymore to any well-understood 
underlying process. Thus one has to impose further conditions on P. 

One way to re-establish the connection to the underlying process, in our case to the 
simple symmetric RW, is to limit the number of non-placebo cookies per site. To this 
purpose, we denote by 

(L2) M{z) := inf{j G No | Ve G £: Vi > j : u;{z,e,i) = l/(2(i)} 

the number of cookies at site z G Z'^, if we do not count placebo cookies which are only 
followed by more placebo cookies. (Here inf = oo.) Note that under assumption (IID) 
(resp. (SE)) M(z), z G Z"^, is an i.i.d. (resp. stationary and ergodic) family of random 
variables. Again, if M = then {Xn)n>Q is the simple symmetric RW, whereas for 
RWRE we have M{z) G {0, oo}. 

In the next four short subsections we present the most commonly studied measures 

p on n. 

1.1. The original ERW model and a modification (no excitation after the first 
visit). ERWs were introduced by Benjamini and Wilson in [BW03] for Z'^,(i > 1, with 
emphasis on d > 2. There the walker gets a bias in the direction ei upon the first visit to 
a site, whereas upon subsequent visits to the same site he jumps to a uniformly chosen 
neighbor. More precisely, in the notation introduced above, there is a p G (1/2, 1] such 
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that F = 5cj, where for ah z G 



yd 



a;(z,ei, 1) = 3, ^(z, -ei, 1) = ^— and 
(BW) d d 

uj{z,e,i) = — if i G N and e G <5 \ {ei, — ei} or if i > 2. 

In this special environment uj one can compare the ERW with a simple RW {Yn)n>o by 
coupling these processes so that (X„ — Yn) ■ ei is non-decreasing in n and X„ • = • 
for alH = 2, . . . , (i and n > 0. 

A natural extension of this model is obtained by fixing an arbitrary direction i G 
M'^\{0} and assuming that all the cookies induce a drift in that direction. In jMPRV"! 
Th. 1.2] the setting is extended to measures P which satisfy (IID), (UEL), and for which 
there is an £ G M'^\{0} such that 

3A > : Va;(0,e, 1) e-^ > A P-a.s. and 

(MPRV,) 

a;(0, e, i) = a;(0, — e, i) P-a.s. for all e G iS, i> 2. 



1.2. Any number of ^-positive cookies per site. One way to further generalize the 
models described in Section 11.11 is to lift the restriction on the number of non-placebo 
cookies, still requiring each cookie to induce a non-negative drift in the same general 
direction. Such a model was introduced in ^Zer05j for Z and in |Zer06| for WJ^^d > 2 
(and for strips as a graph in between Z and 1?). It is assumed that P satisfies (SE) if 
d = 1 and (IID) and (UEL) if d > 2 and that for some I G M'^\{0}, 

(POS^) ^tj(0,e,i) e-£ > P-a.s. for aU i G N. 

A useful fact in this setting is that (X„ • i)n>o is a Po,i^-submartingale. 

Cookies which satisfy the inequality in (POS^) are called {l-)positive. (Negativity is 
defined by the opposite inequality.) 



1.3. Boundedly many positive or negative cookies per site {d = 1). This model 
was introduced in [BSOSal IKZ08] . Assume (IID), (WEL), and that the number of non- 
placebo cookies and their positions within the cookie stacks are bounded, i.e. 

(BD) there is a deterministic M G N such that for ah z G Z^: P-a.s. M{z) < M. 

This model is probably the most studied. Currently, there is a rather complete picture, 
which includes criteria for recurrence and transience, laws of large numbers, ballisticity, 
functional limit theorems, and large deviations. 

This model can also be considered in higher dimensions, but so far there has been 
little progress for Z"', d > 2. Practically all work that is done on this model for d = 1 
uses a connection with branching processes with migration. This connection allows to 
translate main questions for this non-markovian model into questions about branching 
processes, which are markovian. The branching process approach was also useful in 
considering ERW on trees (see [BS09] ) but it completely breaks down on Z'^, d > 2. 
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1.4. RW perturbed at extrema {d = 1). One of the historically first studied non- 
markovian RWs which fits into the above setting is the so-called RW perturbed at ex- 
trema, see e.g. [Dav99j and the references therein. This is a nearest-neighbor process 
(^n)n>o on Z which starts at and satisfies 

{p if n > 1 and Yn = maxj<„ Yi, 
q if n > 1 and Yn = mini<„ Yi, 
1/2 otherwise 

for given p,q ^ (0, 1]. It has been noted in \BY\ Sec. 1] that this walk can be viewed as 
an ERW under the averaged measure as follows: Let {Mz)z(=z be independent random 
variables w.r.t. some probability measure P such that P[M^ = k] = p{l - pY~^ for 
k,z>l, P[Mz = k]= q{l - qf-^ for /c > 1, z < -1 and Mq = 0. Set for all z G Z and 

i G N, 

{1 if z < and i < or if z > and i = M^, 
if z < and i = or if z > and i < M^, 
1/2 ifi>M^ 

and let P be the distribution of uj on Q. (Note that {Mz)zei. iM{z))z£z as defined 
in (II. 2p have the same distribution unless p = 1/2 or q = 1/2.) Then the ERW X has 
under Pq the same distribution as (Yn)n>o- However, from the point of view of ERW as 
introduced above this measure P seems a bit unnatural since it does not satisfy (SE). 
Therefore, this model will not play an important role in this paper. For a variant of this 
model which does satisfy (SE) see |PinlO] and Remark 13.141 

Let us describe how the present paper is organized. At the end of this section we 
introduce some notation. In Section [2] we deal with the basic question when the range of 
the ERW is finite and when it is infinite. This will be useful in Section [3l which considers 
recurrence and transience. There we discuss zero-one laws for (directional) recurrence 
and transience and collect the known criteria which distinguish between these two cases. 
In Section[4]we establish strong laws of large numbers, i.e. the existence of a Po-a.s. limit 
V of Xn/n as n — )• oo. Section [5] is devoted to the question whether u = or u 7^ 0. We 
also discuss in this section in more detail the connection to branching processes with 
migration mentioned above, which is a useful tool when d = 1. In Section [6] we consider 
one-dimensional and functional limit laws for convergence in distribution. In the final 
section we quote some results which did not fit into any of the previous sections. 

Sections [3][6] are divided into two subsections each. The first subsection deals with 
the one-dimensional situation, the second one considers the multi-dimensional case. 

Notation. For A; G Z we set := inf{n > | X„ = k}. We need some notation for 
the environment which is left over after the ERW has eaten some of its cookies. For any 
w G J G No U {00} and {xj)j<j G (Z^)-^, 

Tp{uj, (xj)j<j)(z,e,i) := uj{z,e,i + #{0 < j < J \ xj = z}) 

defines the environment ip{u}, {xj)j<j) obtained from a; by following the path {xj)j<^j 
and removing the currently first cookie each time a site is visited. In this context we 
sometimes need an independent copy of the ERW X, which we denote by X' . By 

[/ = y we mean that U and V have the same distribution. Convergence in distribution 
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is denoted by =^. Saying that A <^ B P-a.s. means P[A\B] = 0. We write E[Z,A] := 
E[Z ■ 1a] for random variables Z and events A. The integer part of t G M is denoted by 
[t]. 

2. Finite or infinite range 

To the best of our knowledge the question whether the range {Xn | n > 0} of the 
ERW is finite or infinite has not been considered in the literature yet. In this section 
we give necessary and sufficient criteria for the range to be finite. In particular, under 
natural conditions the range is either Po-a.s. finite or Pq-&.s. infinite. This will be useful 
in Section [3l First, we introduce some notation. 

Definition 2.1. For x G Z'^ and e €z £ write x x+e if and only if X]j>i ^{^^ e, i) = oo. 
Define bp := P[Ve £ F : ^ e] for F O £. For e £ £ write be instead of 6{e}- 
The transitive closure in Z"^ of the relation is denoted by as well. Moreover, 
:= {y G Z'^ I X 4 y}. 

The meaning of x y is illustrated by the following lemma, which follows from the 
Borel-Cantelli lemma. 

Lemma 2.2. (d > 1) Let oj £ Cl and x,y £ with x ^ y. Then on the event that the 
ERW visits X infinitely often, y is Po.oj-fl-S- visited infinitely often as well. 

Theorem 2.3. (d = 1, range) Assume (SE) and (EL). 

(a) If hi > and 6_i > then the range is Pq-u-s. finite. 

(b) If bi =0 and > then PQ-a.s. Xn — )• +oo as n ^ oo. 

(c) If bi > and 6_i = then PQ-a.s. Xn — )• — oo as n ^ oo. 

(d) If bi = and 6_i = then the range is PQ-a.s. infinite. 

As we shall see in the proof in case (a) the walker eventually gets stuck between two 
essentially reflecting barriers of cookies. A barrier to his left is reflecting to the right and 
a barrier to his right is reflecting to the left. In case (b) there are only barriers reflecting 
to the right. They act like valves. Once the walker has passed any of them from left to 
right he has a positive probability never to penetrate it in the opposite direction. Case 
(d) is the richest case. 

Lemma 2.4. (d = 1) Assume (SE). 

(2.1) Let 6_i > and assume (EL). Then Po[Vn > : X„ > 0] > 
and Po[mfn:>Q Xn > — oo] = 1. 

(2.2) IfPo[yn > : X„ > 0] > then PQ-a.s. {sup„>oX„ = oo} C {X„ oo}. 

Proof of Lemma \2.4\ Assume 6_i > 0. If all the jumps from go to 1 then Xn > for 
all n > 0. Therefore, 

Po[Vn>0: Xn>0] > E[7ro], where vr^ := ]^ tj(z, 1, i) = J|(l - cj(z, -1, i)). 

i>l i>l 

By 6_i > and (EL) we have ^[ttq] > 0, which yields the first statement. Similarly, 
if inf„X„ = — oo then the walk jumps for each z < at least once from z to z — 1. 
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Therefore, for all a; E 0, 
(2.3) Po,^ 



inf X„ 

n>0 



-oo 



< rid 

z<0 



T^z) < exp 



z<0 



By assumption (SE) the sequence {7rz)z<o is stationary and ergodic. Since E[7ro] > the 
right-hand side of (|2.3p vanishes P-a.s. due to (SE). Hence Po-a.s. inf„X„ > — oo. 

For the proof of (j2.2p let k,m £ f^, k < m and let {J-n)n>o be the filtration generated 
by X. Then for all uj £ ^l, Po^^-a.s. on the event {sup„X„ = oo}, 



0,aj 



lim inf X„ > k Tt„ 



> Pq,uj [Vn > : X„ > m I J"t„ 



(2.4) 



[Vn > : X > m] 



by the strong Markov property for the Markov chain ((Xj)o<i<n)n>o- However, since 
^'(a;, {Xn)n<Tm){x) and uj{x) differ only at sites x < m the expression in (j2.4p is equal 
to Pm,i^[Vn > : Xn > m] which is, due to (SE), P-a.s. for infinitely many m G N larger 
than e := Po[yn > : Xn > 0]/2. Hence, on the event {sup„X„ = oo}, PQ-a.s., 



E < lim inf Pr 



0,aj 



lim inf Xn > k \ Ft^ 



'-{liminfn^oo X„>A;} 



by Levy's 0-1 law. Consequently, PQ-a..s. {sup„X„ = oo} C {liminf^^oo -'^n > k}. 
Letting A; — t- oo then yields the claim. □ 

Proof of Theorem \2.3[ Statement (a) follows from (12. ID and its corresponding counter- 
part for the case bi > 0. For the proof of (b) observe that by (12. 1|) Po-a.s. inf„ Xn > — oo. 
Therefore, Pq-^.s.: 



{X„^00}^C [J{Xn = z i.o.} C 



z£l 



sup Xn = oo 

n>0 



2T},i23J 

C {Xn oo}. 



which implies claim (b). Claim (c) follows from (b) by symmetry. In case (d), Po-a.s., 



sup \Xn\ < oo [> C [\{X„ 

n>0 ' 



z i.o.} C 



z& 



SUpX„ = oo > C < sup \Xn 
n>0 J I n>0 



oo 



which yields the claim. 



n 



If one strengthens the assumption (SE) to (HD) then a statement similar to Theorem 
can be made also in higher dimensions. The following result builds upon [HSat 
Lem. 2.2, 2.3], which deals with RWRE with possibly forbidden directions. It puts the 
example given in [Zer06|. Rem. 1] in a general framework. 

Theorem 2.5. (d > 1, range) Assume (IID) and (EL). If there is an orthogonal set 
F C £ such that bp = then the range is Po-a.s. infinite. If there is no such set then 
the range is P^-a.s. finite. 

Lemma 2.6. {d > 1, |HSal Lem. 2.3]) P[#Co = oo] = 1 if and only if there is an 
orthogonal set F C £ such that bp = 0. 



For completeness we include a proof of this lemma. 
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Proof of Lemma \2.(A If there is an orthogonal set F C £ with bp = then there is P-a.s. 
a nearest-neighbor path {yn)n>o starting at yo = with yn ^ Vn+i and Vn+i — Vn £ F for 
all n > 0. Since F is orthogonal this path is self-avoiding and hence {un | > 0} C Co 
is infinite. Conversely, assume that there is no such set F. Then 

{#Co < oo} D jCo C {0, 1}'^} D |Vx e {0, l}'^ Ve G F^. : X ^ X + e} , 

where F^ := {{—l)^'^^ei \ i = 1,. . . ,d} is the (orthogonal) set of directions pointing 
from X towards the complement of {0, 1}'^. By assumption bp,^ > for all x G {0, l}'^ 
and therefore, by independence, P[#Co = oo] < 1. □ 

Proof of Theorem \2. 5[ Following the idea behind [HSal Lem. 2.2] we shall show that the 
range is Pq-^.s. infinite if P-a.s. #Co = oo and Pq-^.s. finite otherwise. The claim of 
Theorem 12.51 then follows from Lemma 12.61 

To prove the first implication we assume that Co and hence all C^, x E Z"^, are P-a.s. 
infinite. Then Po-a.s., 

I n > 0} < oo} C U {X„ = xi.o.}^ P U {C, C{X„|n>0}} 

^ I n > 0} = oo} . 

This proves the first implication. For the opposite implication assume P[#Co < oo] > 0. 
Choose S C Z'^ finite such that P[Co = 5"] > 0. By (EL) and Definition O there is 
7 G N, strictly larger than the || • ||oo-diameter of S, such that P[i?o] > 0, where for 
X G Z'^, 

:= lc^ = S + x, ^ uj{y,y + e,i) <j, 

yeCx,ieN,ee£:y+e<^C^ 

^yeC^,ieN: ^ uj{y,y + e,i) < 1 - 

Choose for all e £ £ some Se € 5 which minimizes S 3 x x ■ e. Furthermore, define 
the increasing sequence of stopping times ak ■= inf{n G N | ||X„||oo = ^7} < 00, A: € N. 
Then for all A; > 0, by partitioning, 

(2.5) Pokfc+i < 00] = ^ Po[ak+i < oo,X^^ = x,Bx_s,] 

eS:£,x:\\x\\ao=x-£=k-f 

(2.6) + Yl Po[^fc+i <oo,X,, =x,S^_J 

First observe that for all e E and x G Z*^ with ||x||oo = x ■ e = k^, 

(2.7) A;7 < Halloo < (A; + 1)7 ioi all z £ S + x - Se- 
The summands in (|2.6p are easy to handle: 

PO [c^fc+l < 00, = X,P^_sJ < E [Po,a;[o-fc < OO, X^^ = x],P^_^J . 

Observe that Po,aj[o"fc < 00, X^^, = x] is (T(a;(z, •, •); ||z||oo < A;7)-measurable, whereas 
B^_s £ a{uj{z, •, •); ||2;||oo > kj) by the first inequality in (12. 7p . Therefore, by (IID), the 
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expression in ()2.6p can be estimated from above by 

(2.8) Yl ^ [PoA<^k < oo, X^^ = x]] P [5^_,J = Pokfc < oo] F[B^]. 

e&£,x:\\x\\cx>=x-e=k'y 

We now turn to the right-hand side of (j2.5p . Due to the second inequality in ()2.7p its 
summands can be estimated from above by 

(2.9) Po < oo, X^^ = X, P^_s^, {X„ ■.n>ak}%S + x-Se] 



-Px,V(a;,(X„)„<,J [{X'n : n > 0} <^ S + X - Se] , (7k < OO, X„^ = X, P^._, 

where we used the strong Markov property. By the first inequahty in ()2.7p we may 
replace in the last expression ilj{oj,{Xn)n<(ii,) by uj and get that the quantity on the 
right-hand side of ()2.9p is equal to 

E [Po,^ kfc < oo, X^, = X] P^,^ [{Xn ■.n>{)}<lS + X-Se], Px-se] 

(2.10) Po [<Jk < oo, X,, = x] E [Po,.; [{Xn:n>0}^S- s^] , P-sJ • 

On the event P-s^ any walker who starts inside the cluster S — Se = C-s^ at and 
eventually leaves this cluster has to cross a bond {y, y+f) with y G C-se and y+f ^ C-g^- 
Therefore, on B-g^, 

Po,u[{Xn\n>0} ^S-Se]<l- n E a;(y,y + /,i)J 



-c-y 



< l-expf-c ^ uj{y,y + f,i)\ < 1 - e" 

where c is a finite constant such that ln(l — x) > — cx for all < x < 1—7^^. Summariz- 
ing, we get from ([22]) and (f2TI)]l that the sum in ([23]) is at most Pq [ak < 00] (1 - e"^^) P[Po]. 
Together with ()2.8p this implies by induction 

PoK+i < 00] < (1 - e-^^P[Po])PoK < 00] < (1 - e-^^P[Po])^ 

Hence there is Po-a.s. some k with ak = 00, which implies the finiteness of the range. □ 



3. Recurrence and transience 

Since ERW is not a Markov chain the standard definitions of recurrence and transience 
do not apply right away in this setting. 

Definition 3.1. We call an ERW X satisfying (SE) recurrent if it visits Po-a.s. every 
site 2: G Z"^ infinitely often. It is called transient if Po-a.s. no site is visited infinitely 
often, i.e. if Po-a.s. — t- 00 as n — t- 00. For any direction i £ M'^\{0} we say that the 
ERW is transient in direction £ if Po-a.s. Xn • £ — >• 00 as n — )• 00. We set 

Ai := I lim X„ • ^ = ooj . 

In— >oo J 

In (i = 1 transience in direction 1 (resp. -1) is also called transience to the right (resp. 
left). 
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Figure 1 . For the proof of (|3^ 



3.1. Results for d = 1. 

Theorem 3.2. (d = 1) Assume (SE) and (EL). 
Then Po[\Xn\ ^ oo] = Po[^i U G {0, 1}. 



The proof uses the followmg lemma. This type of lemma is standard, see e.g. |Zer06t 
Lem. 9] for references. 

Lemma 3.3. (d = 1) Assume (SE), (WEL), and Po[Ai] > 0. Then also 

(3.1) Po[{Vn > : X„ > 0} n Ai] > 0. 

Sketch of the proof of Lemma VJ.'Ji First, one shows that for all z G Z and G such 
that a;(z, l,i) > for all i > 1 and Pz,tj[^i] > one also has 

(3.2) P.,a;[{Vn > : X„ > z} n Ai] > 0. 

The proof of this can be done along the lines of the proof of |Zer051 Lem. 8]. One simply 
erases the (finitely many) excursions from z to the left of z and visits the sites to the 
right of z in the same order as before, see Figure [TJ For the proof of ()3.ip note that by 
assumptions (SE) and (WEL) there is P-a.s. some z > such that 

< Pol^i, Vi G N : a;(z,l,i) > 0] 



P. 



Therefore, by ((32]), 

< So 



Z,tp{ul,{Xn)n<T:,) 



P. 



[Ai], T,<oo, Vi G N : uj{z, 1, i) > 



zM'^,iXr^U<T,)[{'^'>^' >0:X^>z}nAi], T^ < oo 
(3.3) < Pz[{yn > : X„ > z} n ^i] 

since ip{uj, {Xn)n<Tjix, -r) = ^(xrr) for x > z. Due to (SE) the right-hand side of 
([33]) is equal to Po[{Vn > : X„ > 0} n vli]. □ 

Proof of Theorem \3.2l Since the ERW has bounded jumps we have Po-a.s. {\Xn\ — ?• 
oo} = ^1 U A-i. Now we consider the four cases of Theorem 12.31 In cases (a), (b) 
and (c) the 0-1 statement is obvious due to Theorem 12.31 For case (d) we assume 
bi = 6_i = and Pofl-'^nl — >■ oo] > 0. Without loss of generality we assume -Po[^i] > 0. 
By Lemma [33] and (EL), Po[Vn > : X„ > 0] > 0. Therefore, Po-a.s., 

{\Xn\^ ooY <z\\{Xn = z i.o.} C <^ sup X„ = OO ^ C C { |X„ | ^ oo} . 

-^■w U>0 J 



This implies Po[|X„| — )• oo] = 1. 



□ 
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Corollary 3.4. {d = 1) Assume (SE) and (EL). Then the ERW is either recurrent or 
transient or has Po-a.s. finite range. 

Proof. We consider again the four cases of Theorem 12.31 In cases (a)-(c) the claim of the 
corollary is obviously true. For case (d) assume 6i = = According to Theorem 
13.21 Poll-'^nl oo] is either or 1. In the latter case the walk is transient. In the former 
case there is Po-a.s. some z £ Z which is visited infinitely often. By Lemma [2. 21 all other 
sites are Po-a.s. visited infinitely often as well, i.e. the walk is recurrent. □ 

Problem 3.5. {d = 1) The event in Theorem 12.31 that the range is infinite can be 
rephrased as {sup„ = oo}. Dropping there and in Theorem 13.21 the absolute values 
raises the following problem: find conditions which imply 



(3.4) 


Po 


sup Xn = OO 
.n>0 




inf Xr, = — oo 

n>0 


G {0,1} 


and /or 


(3.5) 




Po[Xn 


oo], 


Po[Xn -OO 


] e {0,1}. 





Two such sets of conditions are given in Theorem 13.101 below. It is not difficult to see, 
using Theorems 13.21 and 12.31 and Lemma [2. 2 1 that under the assumptions (SE) and (EL) 
the two 0-1 statements (|3.4p and (|3.5p are equivalent. See also Problem 13.201 

Next we present some criteria for recurrence or transience. First we consider the case 
M(z) < 1, z G Z, where the walk is not getting excited about the sites which it has 
visited before. 

Proposition 3.6. {d = 1) Assume (SE), (WEL) and F-a.s. M{0) < 1. Then the ERW 
is recurrent. 

One could prove this statement by combining a monotonicity argument as in Propo- 
sition 142] below (see e.g. |Zer051 Th. 16]) with Theorem 13.101 (13. 9j) below. However, we 
present here a more direct proof in the spirit of |BW031 Section 2]. 

Lemma 3.7. Let (Z„)„gp^ be a stationary and ergodic sequence of non-negative random 
variables with E[Zi] > 0. Then J2n ^n/n- = oo almost surely. 

Proof of Lemma \3. 7| By the ergodic theorem one can recursively choose positive integers 
ink)keN such that for all k > 1, > Sk-i := ni + . . . + n^-i and 

P[B'k]<k~^ where Bfc := |— Yl Zn>E[Zi]/2\. 

By the Borel-Cantelli lemma there is a random i^T S N such that almost surely all events 
-Bfc, k > K, occur. Hence, since Zn> almost surely. 



EZn y sr-^ sr^ y nk 1 ^ ^ E[Zi 

n ~ ^—^ ^-^ n ~ ' Si, nu ' " ~ ^—^ 4 

n>l k>K n=Sk^i+l k>K " n=Sk-i+l k>K 



□ 
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Proof of Proposition By Theorem 12.31 (d). Po-a.s. sup„>o l-'^nl = oo. Therefore, 



(3.6) Po[{^n = Oi.O.}'^] < Po 



{Xn = i.o.}^ n <j supX„, = oo 

,n>0 



(3.7) + Po 

The term on the right-hand side of ()3.6p is equal to 

Po 



{Xn = i.o.}^ n <^ inf X„ 

' n>0 



-OO 



iGN 



(3.8) 



hm E 



IJ {Vfc > L : Tfc < oo} n {Vn > Tl : X„ > 0} 
PoATl < oo] J] Pfc,^jTfc+i < To: 



k>L 



where := ip{uj, {0,1,... ,k- 1)). Here we used that Po,t^-a.s. Pfc_^(^_(x„)„<j,J [^fc+i < 
^o] = Pk,uj'[Tk+i < To]. Observe that 



Pk,u.'jTk+i < To] = 1 - uj{k, -1, l)Pk^i,^'^jTk+i > To] = 1 



2uj( 



-hi) 



k + l 



by the gambler's ruin problem for the simple symmetric RW on Z. Therefore, Lemma [3.7l 
applied to Zn+i ■= 2uj{n, —1, 1) yields that the infinite product in (13. Sp P-a.s. vanishes. 
Therefore, the term on the right-hand side of (13. 6[) is zero. By symmetry the same holds 
for the expression in ()3.7p . Consequently, by Lemma 12.21 any z G Z is Po-a.s. visited 
infinitely often. □ 

Remark 3.8. (d = 1, first return time to the origin) |AR05l Section 3.3] deals 
with model (BW) for d = 1 and any p € (0, 1) and employs a physical approach to show 
that Pi [To > n] ~ n^^-*^ as n — )• oo. 

If one allows more than just one cookie per site then the walk may become transient. 
Whether this happens or not depends under certain conditions on the parameter 

5:=E ^ a;(0,e,i)e 

if it exists as an element of (MUjitoo})'^. (We shall see in Sections [5] and [6] that for d = 1 
the parameter 5 characterizes other phase transitions as well.) To interpret 5, observe 
that after consuming a cookie oj{z, •, i) the walk is displaced on average by Yle ^i^-> ^' ^)^' 
which we call the drift stored in that cookie. Thus the parameter 5 is, when it exists, 
the expected total drift stored in a cookie stack. 

Remark 3.9. (ti = 1, w.l.o.g. 5 > 0) Observe that for d = 1 replacing w by 1 — u 
switches the sign of 6 and that for each uj the distribution of X under Pq^i-ui is the 
same as of {—Xn)n>o under Pq^uj. Hence when investigating the behavior of X one may 
restrict oneself to the case 6 > 0. 

Theorem 3.10. (d = 1, recurrence, transience [ZerOSj Th. 12] [KZOSj Th. 1]) 

Assume either 



(3.9) 



(SE), (POSi) and¥[uj{0,l, 



(1,1/2,1/2,...)] < 1 or 
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(3.10) (IID), (BD), and (WEL). 

Then the ERW is recurrent if 5 £ [—1,1], transient to the right if 5 > 1 and transient 
to the left if 6 < — 1 . 

Note that in the case P[a;(0, 1) = (1, 1/2, 1/2, . . .)] = 1 one has triviahy Po-a.s. Xn = n, 
which makes the walk transient to the right although 6 = 1. Observe also that the 
above criterion for recurrence/transience of ERW is quite different from the one for 
one-dimensional RWRE due to Solomon, see e.g. [Zei04l Th. 2.1.2]. 

Idea of the proof of Theorem \3.10\ in case 1^3. 9\) . Let 6 > and assume that the walk is 
either recurrent or transient to the right. Consider 

n-l 

Mn := Xn - Dn, where L>„ := ^ (2a; {X^, 1, #{k<m\Xk= - 1) 

m=0 

is the total drift stored in the cookies which have been consumed by the walker before 
time n. By the Doob-Meyer decomposition of the submartingale {Xn)n>o the process 
(M„)„>o is a Po,w-™£irtingale w.r.t. its canonical filtration. A naive application of the 
optional stopping theorem yields that the expected drift Eq^i^IDt,^] stored in the cookies 
which have been consumed by the walk by time T^, A; > 0, is equal to Eq^i^[Xt^] = k. 
We now compare this quantity to the expected total drift k6 stored in all the cookies 
u{z, ■,i),i > 1,0 < z < k. 

If the walk is transient to the right then it consumes only finitely many cookies to 
the left of 0. Hence, if 5 < 1 then even consuming all the cookies between and k 
before time would not be enough, for k large, to satisfy the required total demand 
Eo,uj[DTk] = Hence the walk cannot be transient to the right if (5 < 1. 

Conversely, if (5 > 1 then the walk cannot afford to return too often to before time 
Tfe because otherwise it would eventually eat most of the cookies between and k — 1 and 
thus exceed its dietary restriction Eq^i^[Dt^] = k. This indicates that the walk cannot 
be recurrent in this case. 

This argument can be made precise in case (j3.9p . An even less formal argument is 
given in |AR05l p. 2569]. □ 

The proof of Theorem 13.101 in case (j3.10p relies on branching processes similar to the 
ones used in the proof of Theorem 15.21 which is sketched below. 

Problem 3.11. Can one replace in (|3.10p the assumption (HD) by (SE)? 

Problem 3.12. Compute in the transient case the probability Pol^n > 1 : X„ ^ 0] 
never to return to the starting point. See [ Zer05| Th. 18] for an example. 

Remark 3.13. (Strips) A result similar to Theorem 13.101 has been shown in [Zer06t 
Th. 2] for ERWs on strips Z x {0, 1, . . . , L — 1}, L E N, under assumptions similar to 

Remark 3.14. {d = 1, RW in "have your cookie and eat it" environments) A 

self-interacting RW Y = {Yn)n>o on Z called RW in a "have your cookie and eat it" 
environment has been introduced in [Pinl0| . There, "at each site x, the probability of 
jumping to the right is u]{x) G [1/2,1), until the first time the process jumps to the 
left from site x, from which time onward the probability of jumping to the right" from 
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that site is 1/2. Here the sequence {uj{x))xez (with values in [1/2, 1) ) is assumed to be 
stationary and ergodic. 

Note that if u}{x) = q for x < the RW Y behaves on the negative integers in the 
same way as the RW perturbed at extrema, which we described in Section 11.41 There 
we also showed how a RW perturbed at extrema can be viewed as an ERW. The same 
applies to Y with the difference that the measure P which provides the environment 
for Y does not lack spatial homogeneity but satisfies (SE). Note however that neither 
(POSi) nor (BD) nor (WEL) are fulfilled by this P. Nevertheless, although P does not 
meet the requirements of Theorem 13.101 the conclusion of Theorem 13.101 is still true for 
this P as stated in jPinlOl Th. 2]. See also Remark 15.61 

Remark 3.15. (d = 1, RWRE as underlying process) In |Bau) the simple sym- 
metric RW as underlying process is replaced by a RWRE which is transient, say, to the 
left. On the first > visits to z G Z the ERW is deterministically pushed to z + 1, 
only on later visits to that site the RWRE environment takes effect. Here the random 
environment and {Mz)z&z are i.i.d. with ¥[Mq = 0] > 0. Sufficient criteria for transience 
to the left, recurrence or transience to the right of the resulting ERW are given in terms 
of the tail of the distribution of Mq. 

3.2. Results for d >2. The following result is the multidimensional analogue to The- 
orem [3]2j It generalizes Kalikow's zero-one law for directional transience of multidimen- 
sional RWRE as stated in [ZMOll Prop. 3], see also [ZeiOl Th. 3.1.2] and [HSal Th. 1.3] 
for versions with different hypotheses. 

Theorem 3.16. {d> I, Kalikow-type zero-one law) 

Assume (IID), (EL) and let i e R'^XiO}. Then Po[|^n-^| ^ oo] = Po[AiUA^i] G {0,1}. 

The proof follows the one given in [ZMOll Prop. 3]. It uses the following two lemmas. 
The first one is the multidimensional analogue of Lemma 13.31 

Lemma 3.17. {d > 1) Assume (SE), (EL), £ G M'^VlO}, and Po[Ae] > 0. Then Po[{yn > 
: Xn- i>0}r\Ae]> 0. 

The proof of this lemma is similar to the proof of Lemma 13.31 outlined above and is 
identical to that of |Zer061 Lem. 9]. (The general assumption (UEL) in |Zer06j is not 
needed for the proof of |Zer061 Lem. 9] and can be replaced by (EL).) 

Let us denote for any interval / C R by the slab {x G Z*^ : x • £ G /}. The second 
lemma gives conditions under which the ERW cannot visit any slab S[u^^], u < w, 
infinitely often without ever visiting both neighboring half spaces. 

Lemma 3.18. (d > 1) Assume (IID), E[uj{0,e, 1)] > for all e e £ and let £ G M'^\{0} 
and n, w G M with u < w. Furthermore assume that the range of the ERW is Po-a.s. 
infinite. Then 

(3.11) Po[{Xn ■£>u i.o.} n {Vn > : X„ • ^ < w}] = 0. 

Proof of Lemma \3.1^ The proof is a bit more involved than the one of the corresponding 
statement [ZMOlt Lem. 4] for RWRE. Denote by A the event considered in (13. IIP and 
let F be the event that the walker visits only finitely many distinct elements of 5'[„ ,^]. 
It is enough to show that Po[^ n F] = = Po[^ n F% 
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First, we consider PqIAdF'^]. Without loss of generality assume i-ei > 0. Then there 
is € N such that for all x G S[u,w] we have {x + A^ei) ■ £ > w. On the event ACi 
the walker visits infinitely many sets n (Z x {y}), y G Z'^"'^, since each such set 

is finite. Each time the walker visits such a set for the first time he has, due to (IID), 
independently of his past the Po-P^'obability E[a;(0, ei, 1)]^ to walk in the next steps 
in direction ei thus reaching the half space S(^^^^y Having infinitely many independent 
such chances the walker will Pq-sl.s. not miss all of them. Therefore, Po[A Ci F'^] = 0. 

Our treatment of Po[A D F] deviates from the corresponding step in the proof of 
[ZMOU Lem. 4]. The proof is by contradiction. Assume that i-o[^ ^ F] > and recall 
Definition 12.11 Then there is some k £ N such that Po[A n F^] > 0, where -F^ is the 
event that the walker (a) visits at most k elements of 5'[„ „,], (b) has infinite range, (c) 

does not cross any directed edge (y, z) infinitely often unless y z, and (d) visits every 
element of Cy infinitely often whenever y G Z*^ is visited infinitely often. (The events in 
(b)-(d) have full Po-™easure.) 

Denote for x G Z*^ by Bx C Q the event that there is a self-avoiding nearest-neighbor 
path (2/n)n>o starting at yQ = x such that for all n G N, 

(3.12) X G Cy„, 

(3.13) Cy,^ C 5(„oo,x-<?] and 

(3.14) #{Cy„nS{x.e}) < k. 

If Bx occurs denote by {yn{x))n>o a path with these properties. Choose it according to 
some deterministic rule if there are several such paths. 

On the event AD F^ there is at least one random vertex x which is visited infinitely 
often and maximizes x ■ i. The maximal number of such vertices is at most k due to 
(a). For each such x the event Bx occurs. Indeed, by Konig's lemma |Kon271 Lemma 
A] for directed graphs and (b) there is a random self-avoiding nearest-neighbor path 
(yn)n>o starting at yo = x such that all its directed edges {yn,yn~i), n G'N, are crossed 
infinitely many times. Any such path satisfies (I3.12p - (l3.14p for all n G N. (I3.12P holds 
since ym ym-i for all m G N due to (c). Moreover, since x maximizes y ^ y-l among 
all vertices which are visited infinitely often (d) implies (I3.13p . And since the walker 
visits at most k vertices which maximize y y ■ i we also have (I3.14p . 

Therefore, < Po[^ n Fk] < r[[j^Bx]. Hence F[Bx] > for some x G Z"^. Due to 
(IID), (IsJxGZ'* is stationary under P w.r.t. the shifts on Z'^. Hence ¥[Bo] = ¥[Bx] > 0. 
Choose m G N with m + 1 > 3/c/P[So]. Since i'i-B^)xe'Z<'- is also ergodic there is by the 
ergodic theorem, see e.g. [EllOGi Th. A. 11. 5], P-a.s. some random L G N such that 

(3.15) (m + 1) Yl > ^^^nBo]#[-L,L]'' > k #[-L - m, L + mf. 

xe[-L,L]'i 

For all n = 0, . . . , m and all x G [—L, L]'^ for which Bx occurs we have yn{x) G [—L — 
m,L + niY' since {yn{x))n=Q,...,m is a nearest-neighbor path starting at x. By ()3.15p 
there are strictly more than k #[— -L — m,L + m]'^ such pairs (n, x). It follows from the 
pigeonhole principle that there are y G [—L — m,L + m]'^ and pairwise distinct pairs 
(no, xo), . . . , (n fc,Xfc) G {0, . . . , m} x [-L, Vf" such that y = ymixi) for alH = 0, . . . , A:. 
By (|3.12p and (|3.13p . xq, . . . , G C ^(^ocmin, x,-e]- Therefore, xq ■£=... = Xk ■ i 
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and hence xq, . . . ,Xk £ CyCi S^xo-£}- However, since every path {yn{xi))n>o, i = 0, . . . ,k, 
is self-avoiding the sites xo,...,Xk are pairwise distinct as well. But this contradicts 
pli]) . □ 

Sketch of the proof of Theorem \3.1(A By Theorem 12.51 the range of the ERW is either 
finite or infinite. In the first case the statement is obvious. In the second case the 
proof goes along the same lines as the one of [ZM01[ Prop. 3]. Since the increments of 
the ERW are uniformly bounded Pq-&.s. exactly one of the three events or A_(^ or 
y}u<w^u,w occurs, where Au^w '■= {Xn • ^ £ [^J'^'w] i.o.}. Suppose that -Po[^^] > and 
let u < w. By Lemma [3.181 we have PQ-a.s. sup„X„ • ^ = oo on A^^w However, each 
time the process {X^ ■ i)n reaches a new maximum x > w it has by Lemma 13.171 and 
(IID) the same positive chance never to fall back again below x. Consequently, after a 
geometric number of trials (X„ • has reached a level larger than w below which it 
will never fall again. Hence, Po-a.s. Au^w ^uw^ i-^- ^o[^m,«;] = 0. □ 

The main result of |BW03| is that under assumption (BW) the ERW is transient in 
direction ei whenever d > 2. For the proof, one first couples the ERW X in the way 
described in Section [TTT] to a simple symmetric RW Y = {Yn)n>o- Then one considers 
so-called tan points of Y. These are sites x G Z*^ which are visited by Y prior to any 
other point on the "sun ray" {x + kei \ k €'N}. Every time when Y reaches a tan point, 
X reaches a fresh site and eats a non-placebo cookie which pushes it in direction ei. 
Showing that Y has enough tan points then implies transience of X in direction ei. 

However, it seems difficult to adapt the method of tan points to other settings in 
which the drift is not along a coordinate direction or the excitement occurs at later 
visits. However, by combining the martingale approach explained after Theorem 13.101 
and the method of the environment viewed from the particle this result was extended 
in |Zer06t Th. 1] to the following more general result. 

Theorem 3.19. (d > 2, directional transience) 

Assume (IID) and (UEL) and let i £ R'^\{0} such that (POSe) holds with 6 ■ i > 0. 
Then the ERW is transient in direction i, i.e. Pq[A(\ = 1. 

Problem 3.20. {d > 2) Find conditions which imply the zero-one law Poi^^] S {0, 1} 
for all I G M'^\{0} (cf. Problem [331). Are e.g. (IID), (BD) and (UEL) sufficient (just as 

for d = 1, see ([3^01) of Theorem [STO])? 

For RWRE this zero-one law holds under (IID) and (EL) if d = 2, see |ZM01l Th. 1]. 
According to |HSal Th. 1.5] the assumption (EL) can be dropped. For d > 3 it is an 
important open problem, see e.g. |DR10l Open Problem 1.4]. 

Not much is known in general about recurrence and transience in the sense of Defini- 
tion [O for d>2. 

Problem 3.21. {d > 2) Assume (IID) and (UEL). Is the ERW either recurrent or 
transient? 

Remark and Problem 3.22. (d > 2, balanced ERW) The work [BKSllj introduces 
so-called M(di, d2)-WN. This is an ERW on Z'^i+'^2 which upon the first visit to a vertex 
performs a di-dimensional simple symmetric RW step within the first di-coordinates and 
upon later visits to that same vertex performs a simple symmetric RW step within the 
last (i2-coordinates. It is proved that the M(2, 2)-RW is transient and conjectured that 
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the M{1, 2)- and the M(2, l)-walk are transient as well while the M(l, l)-walk is believed 
to be recurrent. 

More generally, consider measures P which are balanced in the sense that P-a.s. 
oj{z, e, i) = uj{z, —e, i) for all z G Z*^, e G iS, z E N. It follows from recent work [PPSj Th. 
1.2, Prop. 1.4] that any balanced ERW satisfying (UEL) in d > 3 returns PQ-a,.s. only 
finitely often to if there are at most max{2, [d — l)/2} cookies wi, . . . E Ms such 
that for all z E Z*^ and i E N there is P-a.s. some j E {1, . . . , A;} such that oj{z, -^i) = uij. 

One may wonder, whether any balanced ERW satisfying (IID) (or (SE)) and (UEL) 
is recurrent if d = 2 and transient if d > 3. For RWRE this is true, see |Zei04t Th. 
3.3.22]. 

Remark 3.23. {d = 3, ERW against a wall) |ABK08j deals with an ERW in a special 
spatially non-homogeneous environment on Z^. The walk starts at 0, is pushed down 
whenever it reaches a new site, but is prohibited to enter the lower half space (i.e. 
w((x, y, z), — 63, 1) = 1 and uj{{x,y,0), —63,1) = for all x,y, z £ Z, z ^ 0,i £ 'N) and 
otherwise behaves like a simple symmetric RW. It is shown, in particular, that this walk 
returns a.s. infinitely often to its starting point. 

A similar statement regarding recurrence of an ERW which is "excited to the origin" 
is made in [KozOTl (1)]. In |Koz07) one can find related open problems. 

4. Strong law of large numbers 

We say that the ERW X satisfies a strong law of large numbers if there is a non- 
random u E M*^, called the velocity or speed of the walk, such that 

lim — — = V Po-a.s.. 

n— >oo n 

4.1. Results for (i = 1. 

Theorem 4.1. (d = 1, law of large numbers) 

// (SE) and (POSi) hold then X satisfies a strong law of large numbers with speed 
V E [0,1]. // (SE) and the 0-1 law (|3.4p hold then X satisfies a strong law of large 
numbers with speed v E [—1, 1]. 

Proof. For the first statement see [ZerOSl Th. 13]. For the second statement observe 
that although the proof of |KZ081 Prop. 13] has been stated under stronger conditions it 
provides a proof of the second claim if Pq [sup^ Xn = 00] = 1 or Pq [inf„ Xn = —00] = 1. 
In the remaining case, when both probabilities are 0, one trivially has Pq-^.s. X„/n — )• 
0. □ 

Next we discuss some properties of the speed as a function of P. We call a cookie 
uj2{z,-,i) stronger than another cookie uJi{z,-,i) if it pushes its consumer more to the 
right, i.e. if uj2{z,l,i) > iOi{z,l,i). One should expect that making cookies stronger 
does not decrease the speed of the walk. More precisely, an environment 002 is called 
stronger than another environment wi if each cookie uj2iz, •, i) in UJ2 is stronger than the 
corresponding cookie uji{z, -,1) in wi. A probability measure P2 on is called stronger 
than another probability measure Pi if there is a probability measure on {(cji, ^2) E 0,"^ \ 
UJ2 is stronger than wi} with first marginal Pi and second marginal P2. The following 
statement is contained in |Zer051 Th. 17] under the additional assumption (POSi). 
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Proposition 4.2. {d = 1, monotonicity of v) If ^2 is stronger than Pi and if the 
ERW satisfies under both measures Ei[Po,a;[']], ^ = 1;2, a law of large numbers with speed 
Vi then V2 > vi. 

Proof. First, we show that for i = 1,2, 

k 

(4.1) lim — = max{7;i,0} Ei[Po,c.[-]]-a.s.. 

If sup„ X„ = 00 then the sequence {k/T].)k>Q is a subsequence of (X„/n)„>o. Therefore, 
Ej[Po,a;[']]-a.s. {sup„ Xn = oo} C {hnifc k/Tk = Vi > 0}. On the other hand, if sup„ X„ < 
00 then Tfc = 00 for some k and thus Ej[Po,a;[']]-a-s. {sup^ X„ < c«} C {lim^ k/T^ = > 
Vi}. In any case (j4.ip holds. From this one can conclude like in the proof of |Zer051 Th. 
17] that max{t;2,0} > max{?;i,0}. (The general assumption (POSi) present in |Zer05] 
is not needed for this conclusion.) Analogously, by considering T_k instead of we 
obtain min{z;2,0} > min{fi,0}. Hence V2 > vi. □ 

Remark 4.3. {d = 1, monotonicity of v w.r.t. swapping cookies) In jHSal21 

Section 5] yet another monotonicity property for v is discussed. It is shown that "one 
cannot decrease the (lim sup)-speed of a cookie RW by swapping stronger cookies in a 
pile with weaker cookies that appear earlier in the same pile (and doing this at each 
site)". For the precise statement we refer to |HSal21 Th. 5.1]. 

Remark 4.4. (d = 1, continuity of v) In |BS08a] deterministic environments oj of 
the form uj{z, 1, •) = (pi, . . . ,pm, 1/2, 1/2, . . .) are considered, where M G N and p = 
{pi,. ■ ■ ,Pm) S [1/2, 1)*'-'^ are fixed. It is shown in |BS08al Th. 1.2] that the corresponding 
speed V depends continuously on p. It is plausible that the method of proof and result 
may work under the assumptions (HD), (BD) and (WEL) as well. 

4.2. Results for d > 1. In the (IID) setting a regeneration structure, which goes back 
to |KKS75) and has been heavily used to study RWRE, see e.g. |Zei041 Section 3.2], 
can be straightforwardly extended to include ERW, see e.g. [Zer051 p. 114, Rem. 3] and 
|BR07[ Section 3]. See also Figure [2] for d=l. 

Lemma 4.5. {d > 1, regeneration structure) Assume (WEL) if d = 1 and (EL) 
if d > 2. Furthermore assume (IID), let £ G M'^\{0}, and assume PqIA^] > 0. Then 
there are Po[ ■ I Ai]-a.s. infinitely many random times n > 0, so-called regeneration 
times, such that Xm ■ i < X^ ■ £ for all m < n and X^ ■ £ > Xn ■ £ for all m > n. Call 
the increasing enumeration of these times {Tf^)k£N- Then the random -valued 
vectors {Xn)o<n<Ti, {Xn - XrjT,<n<Ti+i (i > 1) are independent w.r.t. Po[ ■ \ A^]. 
Moreover, the vectors (X„ — XT-.)ri<n<Ti+i {i > 1) have the same distribution under 
Po[ • I Ai] as (X„)o<„<ri under Po[ • I Vn X„ • £ > 0]. Also EQ[{Xr^ - Xr^) ■ £ \ A^] < oo. 

Note that the assumption (UEL) present in |Zei041 Section 3.2] is not needed in 
Lemma l4.5i Instead the ellipticity conditions needed are inherited from Lemma 13.31 for 
d = 1 and Lemma 13.171 for d>2. This regeneration structure can be used in the same 
way as for RWRE, see e.g. [Zei041 (3.2.8)], to prove the following directional law of large 
numbers. 
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Theorem 4.6. {d > 1, directional law of large numbers) 

Under the assumptions of Lemma \4.5\ the following holds: Pq-g-s. on the event A^, 
(4.2) ,^^ = .,:=''«l(^r^-X^,yi\A,] 

?i->oo n Eo[''2 — Tl I Ai\ 

The challenge is to determine whether vi is strictly positive or not, i.e. whether 
Eo[t2 — Tl I A(] is finite or not, see Section [5l 

Problem 4.7. {d > 1) Assume (IID), (EL), £ G M'^\{0}. Does Xn-i/n converge Po-a.s. 
on {|A^n| — ^ oo}'^ to as n —7- oo? This would generalize |Zer021 Th. 1]. 

Theorem 4.8. (d > 1, law of large numbers) 

Assume (WEL) if d = 1 and (EL) if d > 2. Furthermore assume (IID) and let ii, . . . , 
be a basis ofW^ such that P()[A£^ U = 1 for all i = 1, . . . ,d. Then there are v G M'^ 
and c > such that Po-a.s. 

lim — — S {v,—cv}. 
71— ^oo n 

If, in addition, PqIAi.] = 1 for all i = 1,. . . ,d then X satisfies a strong law of large 
numbers with velocity v € M"^ such that v ■ £i > for all i = 1, . . . ,d. 

Proof The proof of the first statement is analogous to the proof of [DRIOI Th. 1.5] and 
uses Theorem 14.61 The additional assumption Po[^£i U ^-^J = 1; which is not needed 
in [DRIOI Th. 1.5], is due to Problem 14.71 The second statement follows directly from 
Theorem 14.61 □ 



Remark 4.9. Note that by Theorem 13.191 the assumption Po[^£j = 1 in Theorem 
is satisfied if (MPRV^) holds for some £ G M'^\{0} and £i is chosen from a sufficiently 
small neighborhood of i. 

Remark 4.10. {d > 6, LLN via cut points) Using cut points, a law of large numbers 
for RWRE has been proved in |BSZ031 Th. 1.4] in the case where at least 5 coordinates of 
the walk jointly form a standard RW. This method was generalized in [HSul21 Th. 1.1], 
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see also [Holl2l Th. 2.1], to prove a law of large numbers for similar high-dimensional 
ERWs in the (IID) setting. 

Remark 4.11. (d large, monotonicity, continuity and differentiability of v ■ ei) 

For the original model (BW), it has been shown in [HHlOl Th. 1.1] by lace expansion 
techniques, that the first coordinate v-ei is monotonically increasing in the drift param- 
eter p if d> 9. The same approach also allows to prove a weak law of large numbers for 
d>6, see [Rm2\ Th. 2.3]. |Holl2j assumes (IID) and P-a.s. u}{0, ej,i) = l/{2d) for all 
j = 2, . . . , d. Using the same expansion technique, it is shown in [Holl2t Th. 2.3] that 
the velocity is in an appropriate sense continuous in the drift parameters E[a;(0, ei, «)] if 
d > 6 and even differentiable if d > 8. Strict monotonicity for d > 12 is also considered. 
For similar statements regarding monotonicity and continuity in the context discussed 
in Remark EO] see |HSul2[ Th. 1.2]. 

5. Ballisticity 

An ERW is called ballistic if it satisfies a strong law of large numbers with non-zero 
velocity v. 

5.1. Results for d = 1. For recurrence and transience, the number 1, as a value for \5\ 
or M(0), played a crucial role, see Theorem 13.101 and Proposition 13.61 Similarly, as we 
are about to see, the number 2 plays a special role for ballisticity. 

Proposition 5.1. (d = 1, no speed with two cookies) Assume (SE) and M(0) < 
2 P-a.s. and the ellipticity condition P[w(0, 1,1) < l,a;(l,l,l) < 1], P[w(0, -1, 1) < 
l,a;(l, —1, 1) < 1] > 0. // the ERW satisfies a strong law of large numbers with speed v 
then u = 0. 

Proof. Under the additional assumption (POSi) the strong law of large numbers with 
speed has been proven in [ZerOSl Th. 19]. Replacing cookies with negative drift by 
placebo cookies and using Proposition 14.21 therefore yields u < 0. By symmetry also 
u > 0. □ 

Theorem 5.2. {d = 1, (non-)ballisticity [MPVOBl Th. 1.1, 1.3], jBSOSal Th. 1.1], 
|KZn81 Th. 2]) Assume (IID), (BD), and (WEL). Then v < if 6 < -2, v = if 
5 e [-2,2] and V > if 6 > 2. 

Problem 5.3. Can one replace in Theorem 15.21 the assumption (BD) by (POSi)? 

Idea of the proof of Theorem \5.2l The proof relies on a connection with branching pro- 
cesses, which we now describe. The main ideas go back to |Har52t Sec. 6], |Kni63| . 
|KKS75] . and [T6th96j . They were in troduced into the study of ERW in |BS08aj . We 
follow the exposition given in [KMllj . 

By Remark 13.91 we may assume without loss of generality that 6 > 0. It will be 
convenient to use the following coin-tossing construction of X as characterized in (jl.ip . 
Let {Q',J-') be some measurable space equipped with a family of probability measures 

(k) 

-Pq.wi oj €z and ibl-valued random variables , k €z 7j, -i G N, which are for all 
w G independent under Pq.o; with distribution given by Po,lu[bI''^ = ±1] = uj{k, ±1, i). 
The events {sf ^ = 1} (resp. {^f ^ = -1}), i G N, /c G Z, wih be called "successes" 
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(resp. "failures"). Then an ERW X starting at in the environment uj can be defined 
on the probabihty space ,Pq^u) by 

Xo := and X^+i := X„ + 5go<r<n|X.=x„} " ^ 0- 

By Theorem Eini Po[Tn < oo] = 1 for all n G N. Forn G N and /c G Z let 
T„-l T„-l 

■^n,fc ■= ^ ^{Xj=k, x,+i=k-i} and J^^^ := ^ '^{x,=k, Xj+i=k+i} 

j=0 j=0 

be the number of jumps from A; to A; — 1 resp. from k to k + 1 before time T^. Observe 
that for all n G N and A; G Z, 

(5-1) Jn,k = Jn,k+1 + lo<fc<n- 

Therefore, 

Tn = j:jlk + jt,k^n + 2Y^ji, = n + 2 <, + 25;j„V 

k& k<n 0<k<n k<0 

The last sum is bounded above by the total time spent by X below 0. When 5 > 1, i.e. 
X is transient to the right, the time spent below is Po-a.s. finite, and the growth of 
Tn is determined by ^ for < A; < n. Thus, it is enough to consider the "backward" 

process (^Jn,n, <^n,n-i' • • • ' '^n,o) • Obviously, Jn,n = for every n G N. 

Moreover, denote by Fm^ the number of "failures" in the sequence B^'^^ before the 
m-th "success" . Since the last departure from k before time T„ leads to A: + 1 we have 



ji _ j^(k) p(fe) 

n,k n,fc + l 

for all < A: < n. Since the sequence {{Fm^)men)kez is i.i.d. under Pq we con- 
clude that the distribution of ^ji,n, jjm-i^ • • • ' "^no) under Pq coincides with that of 
(Vo, Vi, . . . ,Vn), where V = (Vfc)fc>o is the Markov chain defined by 

Vo:=0, Vk+i := fI^J_^^ for A; > 0. 

Thus it suffices to study V. Observe that ^ is a branching process with the following 
properties: (i) V has exactly 1 immigrant in each generation. The immigration occurs 
before the reproduction, (ii) One can enumerate the individuals in the A:-th generation 

(k) 

in such a way that the number of offspring of the m-th individual in generation 
k is given by the number of failures between the (m — l)-th and m-th success in the 
sequence B^'^^ (Here the time of the 0-th success is 0.) In particular, if 14 > M then the 
offspring distribution of each individual after the M-th one is Geom(l/2) (i.e. geometric 
on {0} U N with parameter 1/2). 
Therefore, we can write for A: > 0, 



A/A(yfc+1) Vk-M+l 

(k) 

m 1 



m=l m=l 
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where (,m\ k > 0, m > 1, are i.i.d. Geom(l/2) random variables and the vectors 
(Ci'\ C2'\ ■ ■ ■ T Cm^^ J k > 0, are i.i.d. under Pq and independent of {^m^)k>o,m>i- For 

(k) 

each k > the random variables (^m ,rn = 1, . . . , M, are in general neither independent 
nor identically distributed. Define the length of the life cycle and the total progeny 
over a single life cycle by 

:= mf{j > 1 1 V,- = 0} and A^ := ^ Vj. 

j=0 

These two quantities partially characterize the regeneration structure of transient ERW 
(see Lemma 14.51 with d = 1 and |KZ081 Lem. 12, (30)]), namely, 

(5.3) a^'^X^.-X,,, d T^i - (X., - 



2 

Detailed information about the tail behavior of and A^ is the key to the proof of 
Theorem 15.21 as well as to the results about scaling limits of T„ and Xn (see Section [6]) . 
There is a large number of papers which study the extinction probabilities of branching 
processes with migration. Unfortunately, they do not seem to include this particular 
setting. In [KZ08j existing results were adopted by introducing appropriate modifica- 
tions of the process V. In [BSOSaj most and in |KM11] all of the required results about 
branching processes were obtained directly. 

Theorem 5.4. r |KMlll Th. 2.1, 2.2]) Assume (IID), (BD), and (WEL) and let 6 > 0. 

Then there are constants Ci,C2 € (0, oo) such that 

lim n^Poia^ > n) = Ci and lim n^^'^Po (A^ > n) = C2. 

n— >oo n— >oo 

For future reference in Section [6] we shall record the following corollary of Theorem 
El and (EHD for transient ERW. 



Corollary 5.5. Assume (IID), (BD), and (WEL) and let 6 > 1. Then there are con- 
stants Ci,Cs £ (0,00) such that 

(5.4) lim n^PoiXr^ - X^, > n) = Ci, 

n— >cxD 

(5.5) lim n^/^Po (ra - n > n) = C3. 



Combining (|5.5p with Theorem 14.61 we obtain Theorem 15.21 □ 

Idea of the proof of Theorem \5.4\ The main point is that the process V killed upon 
reaching is reasonably well described by a simple diffusion. The parameters of such a 
diffusion can be easily computed at the heuristic level. For > M, ()5.2p implies that 

M Vk-M+1 
m=l m=l 

By [BSnSal Lem. 3.3] or pCM Lem. 17], 



M 



.m=l 



1-6. 
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The term ^^^^ Cm + 1 is independent of Ylm=i ~ When Vfc is large, the 

latter is, conditioned on V^, approximately normal with mean and variance essentially 
equal to 2^4. Therefore, the relevant diffusion should be given by the following stochastic 
differential equation: 

dYt = {l-6)dt+yWtdBt, Yo = y>0, t e [0,t^], 

where = inf{i > 0\Yt = 0}. Observe that 2Yt is a squared Bessel process of 
dimension 2(1 — 5). Thus, if 6 > then < oo a.s.. Using the scaling properties of Yt, 

Y 

it is not hard to compute the tail behavior of and Ys ds. The bulk of the work 
is to transfer these results to and . □ 

Remark 5.6. {d = 1, "have your cookie and eat it" RW) According to [PinlOt 
Th. 3] the statement of Theorem 15.21 (except for possibly the critical case \6\ =2) also 
holds for the measure P which reflects "have your cookie and eat it" environments as 
described in Remark 13. 141 

Remark and Example 5.7. (d = 1, 6 does not characterize ballisticity under 
assumption (SE)) The following example shows that one cannot replace in Theorem 
15.21 assumption (IID) by (SE), not even under the additional assumption (POSi). The 
first such example in this context was constructed in |MPV06t p. 290]. Thus, while 5 
characterizes recurrence and transience for d = 1 also in the general setting of (SE) it is 
not sufficient to characterize ballisticity under this assumption. 

Let 1/2 < p < 1. Then there is a RWRE with speed f = in a stationary and ergodic 
environment which uses exactly p and 1/2 as transition probabilities to the right. More 
formally, there is a measure P on which satisfies (SE) and 

P[Vi G N : uj{0,l,i) = p] = 1 - P[Vi G N : w(0,l,i) = 1/2] > 

such that Pq-sl.s. Xn/n — )• as n — )• oo. (Note that (POSi) and 5 = oo hold.) 

To construct such P let {Bz)zez be a stationary and ergodic {0, l}-valued process 
on some probability space with probability measure P such that P[Bq = 1] > and 
E[Z] = oo, where Z := mi{z G Nq | -B-^ = 1}. For example, {Bz)zez could be 
a two-sided stationary discrete renewal process with i.i.d. inter-point distances which 
have an infinite second moment. Then set for all i G N, a3(z, 1, z) = p B^ = 1 and 
oj{z, = 1/2 if Bz = and let P be the distribution of uj on il.. It then follows from 
|Zei04[ Th. 2.1.9 (c)] that Po-a.s. Xn/n ^ as n ^ oo. 

To construct an ERW example which also satisfies (BD) one can replace all cookies 
uj{z,-,i) with i larger than some fixed M by placebo cookies. By Proposition 14.21 this 
cannot increase the speed. However, since (POSi) still holds the speed cannot become 
negative by Theorem 14.11 either and is therefore still 0. 

Remark 5.8. {d = 1, v is not a function of 6.) While under the conditions of 
Theorem 15.21 the value of d determines whether v is positive, zero, or negative, it does 
not determine the value of v, not even under strong assumptions. For example, let 
p G (1/2,1] and M G N such that {2p - 1)M > 2 and define Up^M £ ^ hy setting 
for all z G Z, ujp^Miz,l,i) := p if z < M and ujp^M{z,l,i) := 1/2 if i > M. Then 
the parameter 5 corresponding to P := 6^^^ is equal to (2p — 1)M and therefore the 
corresponding ERW has speed v > due to Theorem 15. 2[ Now pick M' G N such that 
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M' > 6/v and set p' := (1 + 6/M')/2. Then F' := 6^^ , has the same parameter 
6' = 5 as P, yet its induced speed v' is, due to Proposition 14.21 not larger than the 
speed v" = 2p' — 1 = 5/M' < t> of the asymmetric nearest neighbor RW on Z which 
corresponds to P" := 5^^, ^. 

5.2. Results for d >2. It was observed in jBW03t Th. 5] that ERW under assumption 
(BW) is bahistic if d > 4 and left as an open question whether the same holds true in 
dimensions 3 and 2. In two unpublished preprints this question was answered in the 
affirmative by Kozma first for d = 3 and then also for d = 2. The paper [BR07| uses 
a different method to prove this statement. Its authors obtain a lower bound on the 
number of tan points to show that the expected time Eq[t2 — ti] between two successive 
regeneration times is finite which, by (]4.2p . implies ballisticity. 

However, as we already mentioned before Theorem l3.19( methods involving tan points 
might not be easily adaptable to more general settings. Using a related but more general 
approach the following result about ballisticity was obtained in [MPRV] . Here we only 
mention that |MPRV| uses martingale techniques and completely avoids tan points. A 
key ingredient of the proof is a lower bound on the growth of the range of the ERW 
[MPRVl Prop. 4.1]. The positivity condition plays a crucial role in the proofs. (Recall 
from Remark 14.91 that the strong law of large numbers holds in this setting.) 

Theorem 5.9. {d > 2, ballisticity, jBRnTl Th. 1 (i)], [MPRVi Th. 1.2 (i)]) 

Letle R'^\{0} and assume (MPRV^), (IID), and (UEL). Then the ERW is ballistic and 

its velocity v satisfies v ■ i > 0. 

According to [M PRVI Th. 1.1] this result can also be extended to certain processes 
which do not fit into the framework considered here. For more recent developments in 
this direction see |MPj . 

Remark 5.10. {d > 2, positive and negative cookies) Little is known about bal- 
listicity outside of the setting of Theorem 15.91 In |KZ08l Section 9] an example is given 
for an ERW in d > 4 which is balhstic in spite of 5 = 0. For d > 9, |Holl2l Th. 2.2] 
shows, using lace expansion, that if the drift induced by the first cookie is strong enough 
the first cookie can overrule the subsequent cookies and determine the direction of the 
velocity. On the other hand, for d > 2, if the first cookie is weak enough and all the 
subsequent cookies induce a drift in the opposite direction then their infiuence might 
win, see jHoll2t Lem. 2.4]. 

6. Limit laws and functional limit theorems 

In this section we discuss limit laws and functional limit theorems for ERWs under 
the averaged measure Pq. Quenched limit laws are mentioned in Problem and Example 
16.171 at the end of this section. 

6.1. Results for d = 1. There is a rich variety of limit laws and limit processes for 
ERW in d = 1. The limit processes obtained so far in the ERW literature are Brownian 
motion |KZ08] . a certain class of Brownian motions perturbed at extrema |DollH[DK12j . 
the running maximum of Brownian motion [DK12| . as well as, under a different kind 
of scaling, so-called excited Brownian motions |RSj . As a new result we prove here 
functional limit theorems for the model of Section [1.31 with 6 S (1,2) U (2,4] with limit 



E. Kosygina, M.P.W. Zerner 



25 



processes which are strictly stable with indices a G [1/2,2] and skewness parameter 1 
(totally skewed to the right). The proof is based on |Lin78] . 

Let us outline the plan of this subsection. First, we state functional limit theorems in 
the recurrent case. In the transient regime, we start with convergence of one-dimensional 
distributions. Then we recall and compare the notions of convergence in Ji and Mi 
on the Skorokhod space. Further, we state and prove, using |Lin78] . functional limit 
theorems for transient ERWs. Finally, we consider convergence to excited Brownian 
motion. 

Let D[0,oo) be the Skorokhod space, i.e. the space of right-continuous real-valued 
functions with left limits on [0, oo) endowed with the standard Skorokhod topology (i.e. 

Ji, see definition (16. 7p below). Denote by =^ the weak convergence on D[0,(X)) in Ji. 
Unless stated otherwise, we shall assume that all processes start at the origin at time 0. 

We begin with the recurrent case and define the candidate for the limiting process, 
the so-called Brownian motion perturbed at extrema ( |Dav961 IPW971 ICD991 IDav99j ). 
Let a,/3 S (— oo, 1) and let B = {B{t))t>o denote a standard Brownian motion. Then 

(6.1) X^^pit) = B{t) + asnpX^^^is) + (3mf X^^^is) 



s<t 



<t 



has a pathwise unique solution Xa^p = (Xa^^(t))t>o that is adapted to the filtration of 
B (see e.g. |CD991 Th. 2]). It is called (a, /3)-perturbed Brownian motion. In the 90's 
the main purpose of the study of RWs {Yn)n>o perturbed at extrema, as introduced in 
Section 11.41 was to prove functional limit theorems for these walks. And indeed, for 
certain values of the parameters p and q one has 

as n — )• oo, 



n 



where a = 2 — 1/p and /3 = 2 — 1/(1 — g), see e.g. |Dav96t Th. 1.2] for an accessible 
statement and also |Dav99j . 

For the ERWs from Sections 11.21 and 11.31 there are the following results: 

Theorem 6.1. {d = 1, convergence to Brownian motion perturbed at extrema 

[Dolll. Th. 1, Rem. 2], [DK12. Th. 1]) Let 6 £ [0, 1). Assume either 

(6.2) (SE), (POSi), (UEL), and E [sup{i € N : \uj{0, 1, i) - 1/2| > e}] < oo 
or (IID), (BD), and (WEL). Then under Pq, 

-^\n-] Ji 

Xs si-) as n ^ OO. 



n 



Remark 6.2. (Strips) A similar result holds for recurrent ERWs on strips Zx {0, 1, . . . , L- 
1}, L G N, under assumptions similar to (j6.2p . see jPpllll Th. 1]. 

Theorem 6.3. {d = 1, convergence to the running maximum of Brownian 
motion |DK12l Th. 2]) Assume (IID), (BD), and (WEL) and let 6 = 1 and Sit) := 
inaXs<tB(s), t >0. Then there exists a constant b > such that under Pq, 

(6.3) , ^^"'^ 4 S{-) as n ^ oo. 

b^/n log n 
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Problem 6.4. Replace the assumptions (IID), (BD), and (WEL) of Theorem 16.31 by 
(I6.2p . Does the result of Theorem 16.31 remain true? If yes, can one also remove (POSi)? 

Observe that in Theorem l6.3l the limiting process is transient while the original process 
is recurrent. This might seem surprising. For the proof of Theorem 16.31 one first shows 
that (j6.3p holds with S[n-] ■= niaxo<j<[„.] Xi instead of X^^.y Then it is argued ( |DK12t 
Lem. 5.2]) that with probability approaching 1 the maximum amount of "backtracking" 
of Xj from Sj for j < [Tn] is negligible on the scale -^/nlogn for every T < oo. 

We turn now to the transient case 5 > 1. To describe limit laws of transient ERWs we 
need the following notation. For a £ (0, 2] and 6 > denote by Z^^b a random variable 
such that for all u G M, 



(6.4) log E [e 



iuZ, 



a,b 



— i tan(7ra/2) sign u), if a / 1; 
-6|u|flH log |u| sign uj , if a = 1, 



see e.g. [DurlOl (3.7.11)]. Here we agree to set signO to 0. Observe also that Z2fi is just 
a centered normal random variable with variance 26. 

Theorem 6.5. {d = 1, convergence of one-dimensional distributions) Assume 
(IID), (BD), and (WEL) and let v be the speed of the ERW as in Theorem \4-l\ The 
following results hold under Pq. 

(i) If 6 G (1,2) then there is a constant b > such that as n ^ oo, 

^^Zs/2,b and ^^{Zs/2,b)-^^^- 

(ii) If 6 = 2 then there is a positive constant c such that 

(6.5) — > - and — > c in probability as n ^ oo. 

nlogn c 71/ log n 

Moreover, there are a positive constant b and functions D{n) ~ logn andT{n) ~ 
1/ log n such that as n ^ oo. 



(a a\ Tn-c ^nD{n) j ^" " cnT{n) 

(6.6) Zi,h and —— — ^ — => -Zi,, 

n ' c^n log n 

(iii) If S G (2, 4) then as n ^ oo, 

Tn - V'^n Xn-vn 
-^^ ^^5/2,6 and ^1+2/5^2/5 ^ -^5/2,b- 

(iv) If 6 = 4 then there is a constant b > such that as n ^ oo, 

r„ - v-^n Xn-vn 
— , ■ Z2,b and — = =^ -Z2,b. 

Vnlogn v^i '^yniogn 

(v) If 6 > 4 then there is a constant b > such that as n ^ oo, 

Tn - v^'^n Xn-vn 

Z2,b and -Z2,b- 



Moreover, everywhere above X„ can be replaced by inf j>„ X^ or supj<„ Xi 
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Proof. The regeneration structure described in Lemma 14.51 and the estimates ()5.4p and 
(15. 5p play an important role in the proof. Statements (i) and (j6.5p were proven under 
additional assumptions, in particular (POSi), in |BS08b[ Th. 1.1]. These assumptions 
were removed in [KMlll Rem. 9.2]. Parts (iii) and (iv) were obtained in [KMll^ Th. 
1.3]. The second claim of part (v) is contained in |KZ08l Th. 3]. Although part (v) 
was not stated or proven in |KM11] , its proof is almost the same as the one of part (iii) 
(see [KMlll Proof of Th. 1.3, pp. 593-594]). The only difference is that one can use 
standard limit theorems for square integrable random variables instead of those quoted 
in the original proof. 

The fluctuation results (j6.6p do not seem to appear anywhere in the ERW literature. 
The proof of ()6.6p can be written along the lines of |KKS751 pp. 166-168] taking into 
account [KMlll Th. 2.1, 2.2, Lem. 9.1]. The fact that Xt-„ — ^t„_i has infinite second 
moment (see (|5.4p ) requires an application of a limit theorem from renewal theory, which 
is different from the one used in [KKS751 p. 166, line 8 from the bottom]. Namely, the 
deviations of the number of renewals up to time n have fluctuations of order ^ n log n 
instead of ^/E (combi ne [WhiO ll Th. 6.3.1] with [GS691 Ch. 9, Sec. 6, Th. 2]). Apart 
from this, the proof of |KKS751 pp. 166-168] goes through essentially word for word. □ 

It is natural to expect that the same embedded regeneration structure, which was 
useful in the proof of Theorem 16.51 will allow us to obtain the corresponding functional 
limit theorems. Theorem 16.5! suggests that the limit processes should be stable pro- 
cesses, which need not be continuous, and this brings us to the question of choosing an 
appropriate topology on the Skorokhod space D[0,oo). 

In 1956, A. V. Skorokhod introduced 4 metrics on D[0, 1] ( [Sko56j ). These metrics 
generate the corresponding topologies on L)[0, 1], which are called Ji, Mi, J2, and M2. 
One of them, namely Ji, is often called "the (standard) Skorokhod topology" and is 
probably the most widely used in the study of weak convergence of stochastic processes 
on the Skorokhod space. Nevertheless, when the candidate for the limiting process is not 
continuous, one should not necessarily expect the convergence in Ji but only in one of 
the "less demanding" topologies, in our case Mi. This fact is well-known, for example, in 
the study of heavy traffic limits in queuing theory (see [Whi02] and references therein) . 
Let A denote the set of continuous strictly increasing mappings of [0, 1] onto itself. 



RecaU f iBil99( Sec. 12], [Whin21 Section 3.3 (3.2)]) that for xi, X2 G D[0, 1] the Skorokhod 
Ji-distance between xi and X2 is defined by 



The Skorokhod Mi-distance pMi ixi,X2) is informally defined as "the distance between 
the completed graphs of xi and X2, and r^^a". More precisely f |Whi02l Sec. 3.3]), 
for X G D[0,1] let 

r^. := {{z, t) E M X [0, 1] : z = ax{t-) + {1 - a)x{t) for some a e [0, 1]} C M^ 

where x{0—) := x{0), and define the order on as follows: {zi,ti) < (2:21^2) if either 
ti < t2 or ti = t2 and \zi — x{ti—)\ < \z2 — x{t2—)\. Denote by Ux the set of all 
parametric representations of F^;, i.e. continuous non-decreasing (with respect to the 



(6.7) 
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above defined order on T^) functions {u,r) taking [0, 1] onto Fx- For xi,X2 G D[0, 1] let 

PM^{xi,X2) ■■= inf sup |ni(t) - n2(t)| V sup \ri{t) - r2{t)\ 

{ui,ri)eu^^, 1=1,2 yte[o,i] te[o,i] 

Clearly, Ji-convergence implies Mi-convergence. The converse is not true. For both 
examples on Figure [j^ we have pMi{xn,x) — )■ but pj^{xn-,x) t^- as n — )• oo. In the 
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Figure 3. Unmatched jump of the limiting process. 



left picture, a single jump of the limiting function is achieved by a double jump in the 
approximating functions. The right picture illustrates the creation of an unmatched 
jump in the limiting function by continuous approximating functions. Neither situation 
is an obstacle for the Mi-convergence but both prevent Ji -convergence. 
Note however r [Whi02l Sec. 12.4]) that 

(6.8) if pMi{xn,x) — and x £ C[0, 1] then pj^{xn,x) — )■ 0. 

Under natural assumptions (see |Whi021 Sec. 13.6]) the inverse map is continuous with 
respect to Mi. Consider the (right continuous) inverses of the functions in Figure [3] (see 
Figured]) and notice that in the left picture of FigurelHwe have (x~^, x~^) — )• (and 
also uniform convergence) and in the right picture only pM-iix^^ ,x~^) — )• as n — )• oo 
(but neither uniform nor Ji -convergence). This example illustrates that "strengthen- 
ing" of convergence might or might not occur when taking the inverse (compare the 
statements of Theorems 16.61 and 16.71 for 5 G (2,4) below). 



■^FigUreO X= - l[0,l/2) + - 1[1/2,1] • Left: Xn = - l[0,l/2-l/n) + 2 l[l/2-2/n,l/2-l/n) + - l[l/2-l/n,l] • 

{l/4-l/n + 2t/(n-2), if < t < 1/2 - l/n; 
3/4 + n(f- l/2)/2, if 1/2 - l/n < f < 1/2; 

3/4 + 2(f- l/2)/n, ifl/2<t<l. 
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Figure 4. The convergence of inverse mappings. 

We defined the Mi-distance on D[0, 1]. This definition extends to -D[0, T], T > 0, in 
an obvious way. For xi,X2 G D[0, oo) we let pjj^ {xi,X2) denote the Mi-distance between 
the restrictions of xi and X2 to the space D[0,T]. Then (see |Whi021 Sec. 3.3, (3.6)]) 



Pm^{xi,X2) :-- 



-T/ T 



{PNh{xi,X2) A l)dT. 



The distance py {xi,X2) can be defined by replacing Mi with Ji everywhere in the 
preceding paragraph. For further information about the space L'[0,cxd) with metric p'^_^ 
the reader is referred to |Whi02|, Sec. 12.9]. 

We shall return to ERWs. Using the notation introduced in Theorem 16.51 define 
processes ?/„ = (/?„(*) )t>o and = (Cn(i))t>o as follows. 



(i) 
(ii) 
(iii) 
(iv) 

(v) 



If 5 G (1,2) then r/„(t) 

If (5 = 2 then r/„(t) 

If (5 G (2, 4) then r/„(t) 

If 5 = 4 then r?„(t) 



[nt] 



^2/5' 

T[nt\ - c~^[nt]D{n) 



n 



If (5 > 4 then 



T[nt] - [nt]/v 
^2/5 

T[nt] - [ntj/v 
\J n log n ' 
T[nt] - [nt\/v 



n 



Ut) 



X, 



nt] 



^5/2 ■ 

X[nt] - c[nt]T{n) 

c^n log^^ n 

X[nt] - [nt\v 
yl+2/5^2/5 • 

X[nt\ - [nt\v 

v^/'^yjn logn 

X[nt] - [nt\v 



Note that r/„(l) and in{^) are the random variables considered in Theorem 16. 5[ Recall 
the random variables ^5/2,6, 6 > 0, which were defined in (|6.4p . 

Theorem 6.6. {d = 1, functional limit theorem) Assume (IID), (BD), and (WEL) 
and let 5 G (1, 2). Then =^ i as n —)• 00 under Pq. Here ^ is the inverse of a stable 
suhordinator rj for which r/(l) = Z^/2,bj ^'^'^ ^ the same as in part (i) of Theorem \6.5[ 
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We denote by ^ the weak convergence on L'[0,oo) in Mi. 

Theorem 6.7. (d = 1, functional limit theorem) Assume (IID), (BD), and (WEL). 

If 6 ^ (2, A) then ^„ =^ ^ as n —)• oo under Pq. Here is a stable process with index 5/2 

such that ^(1) = — •^5/2,6- If ^ ^ ^ then ^„ ^ \/2hB as n ^ oo. The constant h is the 
same as in the corresponding part of Theorem W. 



Remark 6.8. (case 5 = 2) The case 5 = 2 should have been included in Theorem 16.71 
However, the results of |Lin78j do not cover this case, and a separate proof is needed. 

Remark 6.9. (no Ji-convergence) In the first part of Theorem 16.71 (5 E (2,4)) the 
convergence in Mi can not be replaced with convergence in Ji . The intuitive explanation 
is that the jumps of the limiting process ^ are unmatched by those of the approximat- 
ing processes since the jumps of ^„ are bounded by 2/n^^^ . This phenomenon was 
illustrated by examples in Figure [3] except that the jumps in the limiting process ^ are 
due to centering and, therefore, are negative. See also [Whi021 Section 3.3 and Chapter 
6]. 

Remark 6.10. (convergence of rjn) The weak convergence in Mi under Pq of the 
processes ?7„ to the stable process r] which is characterized by the corresponding one- 
dimensional distribution of Theorem 16.51 can also be established (see |Lin781 Th. 2(i) 
with g{t) = 1, q= lj{t) = h{t) = t] ioi 5 > 2 and Remark EH] below for 5 £ (1,2)), 
but, since our main interest is in we omit the corresponding results. 

For the proofs of Theorems 16. 61 and 16. 71 we shall need the following result from )Lin78] . 

Theorem 6.11. ( |Lin781 Th. 1, Rem. 2]) Let (Cj)ieN i.i.d. random variables such that 
P[Ci < 0] = 0, and set sq := 0, s„ := Y17=i d /'^'^ n G N. Suppose that fi := -E[Ci] < oo 
and the D[0,oo) -valued process w = {w{t))t>o satisfies: w{Q) = and 

/ggN {C,n,w{sn-i + -Cn) - w{sn-i)), n > 1, are i.i.d. 

random variables with values in [0,oo) x Z)[0, 1], 

and for some norming constants a{n), n G N, 

— =^ y (•) as n ^ oo, 
a[n) 

where Y is a stable process with index a. Moreover, define 

MP(tt;) := sup \w{Sn-l+tiCn)-w{Sn~l+ti^iCn)\ -\w{Sn)-w{Sn-l)\. 



Then 



0=to<ti<t2<t3 = l .^-^ 



(2) 

^ y(-) if and only if — — =^ 0. 



//~i/'^a(n) a[n) 

Proof of Theorem \6. 61 By (j3.10p of Theorem 13.101 the ERW is transient to the right. 
Therefore, the regeneration structure described in Lemma 14.51 exists and we may set 

Ci = Xt^^-^ — for i G N and w{t) = T[t]+X-r-^ ~ for ^ ^ [Oi co) and have that (Ci)j>i is 
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i.i.d. and = EqIQ] < oo. Moreover, ()6.9p is satisfied. Therefore, by (I5.4|) and |Whi02[ 
Th. 4.5.3], 

W'(Sfn-l) ^n.-l+l 



n 



2/5 



n 



2/5 



r{2), 



where y is a stable subordinator. Moreover, M^^^^(w] 



0, since w{t) is monotone. By 



Theorem 16. Ill we conclude that (n/fi) ^^''(Tj^.j+Xt 



as n — )• oo. Since ri is 



Po-a.s. finite, the convergence-together theorem |Whi02t Th. 11.4.7] implies that 



(6.10) 



-[n-]+Xr-i^ M- 



Ml 



Taking the inverses (see |Whi02[ Cor. 13.6.3]), we get n-'^/2(S[„.] - X^J fiY- 

where Sn = maxo<j<n^j- Since ri is Pq-sl.s. finite, we conclude that n~^/^S'[„.] ^ 
fiY~^{-). Next we note that has continuous trajectories ( jBer96i Lem. III. 17]). This 

allows us to strengthen the convergence to Ji (see ()6.8p ). i.e. n" -^/^Sin.] 4 fiY-\ Part 
(i) of Theorem 16.51 identifies the one-dimensional distributions of the limiting processes. 

Finally, we would like to replace the maximal process S with the original walk X. It 
is enough to consider restrictions of both processes to intervals [0,r], T > 0, f ^BilM 
Th. 16.7]). To simplify notation, we consider without loss of generality the time interval 
[0,1] instead of [0,T]. The tail estimate (15. 5p for the variables of the i.i.d. sequence 
(tj+i — Tj), i > 1, implies that for every ly > there is K > such that Po[t^j^^s/2^ < 
n] < u for all n E N. For every e > we have 



Pn 



max 

o<t< 



Xi 



nt] , 



> en 



5/2 



<U + P< 



max {Sr, 

0<m<n 



Xr, 



> en 



5/2 



> n 



<iy + Po 



max {Xt 

l<i<[A'n«/2] 



5/2 



<u + PQ[Xr, >en^'^]+PQ 



< 2u + l 



2C^ 



max (Xr- 

2<i<[Kn^/'^] 

< 3z^ 



> en 



5/2 



{enS/^Y^ 

for all sufficiently large n. Now apply the convergence-together theorem. □ 
Remark 6.12. (convergence of 7]n for 6 € (1,2)) From (j6.10p it is only one step from 

the conclusion that r]n =^ f], where is a stable subordinator with r/(l) = Zs/2,b- Indeed, 
a straightforward computation shows that for every T > the Ji- (and, therefore. 
Ml-) distance between n~'^/^T[n.]+Xr^ aiid n^'^^^T^^.] on L'[0,T] converges to in Pq- 
probability as n — )• oo. The claim follows by the convergence-together theorem and part 
(i) of Theorem 16.51 



Proof of Theorem 6.7 The statement of Theorem 16.71 for 5 > 4 is contained in |KZ08t 
Th. 3]. Thus, we assume that 6 G (2,4] (even though the proof works for all S > 2). Set 



Ci = Tj+1 - n, i > 1, and w{t) = X\ 



[t]+Tl 



v[t] — Xt-j, t > 0. By Lemma ITS) {Ci)i>i is 



i.i.d. and (16. 9p holds. Moreover, fi = -Eo[Ci] < c» by (15. 5j) . 
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By Th eorem |M1 ^o[^r2 - ^n] = Atw- Let a(n) := n^/^ if 5 G (2,4) and a(n) 
\J n log n if (5 = 4. We shall show the weak convergence in Ji of 

a{n) a{n) 
Indeed, by ([53]), (l53|), jWhi02l Th. 4.5.3], and [GS691 Ch. 9, Sec. 6, Th. 2] 



Xr^ - nv[n-] J 



^0 and ^"-'^^ ;\ ^ ^ y(-), 
ayn) ayn) 

where y is a stable process with index 5/2. The convergence-together theorem implies 
that the process in ()6.1ip converges in Ji to y := —vY. Finally, we need to check the 
condition {a{n))~^ m'^^^{w) =^ 0. The following two simple lemmas accomplish the task. 
(We state these lemmas for all 5 > 2 setting a{n) = \/n when b > 4.) 

Lemma 6.13. Let 6 > 2. Then, under the conditions stated above, 

Mi^\w)<4iXr„^,-XrJ for all n> I. 

Proof. Let w{t) = wi{t) — W2{t), where wi{t) := X^^t^j^^^ and W2{t) := v[t] + X,-^. Notice 
that the latter process is increasing. Then for n G N and = to < ti < t2 < t^ = 1, 

k(Sri-l + kCn) - w{Sn-l + tj-lCn)!^ " \w{Sn) - w(s„-l)| 

) - Wi{Sn-l + ti-iCn)\ + W2{ ) - W2{Sn^l + ij-lCn) 

- {{W2{sn) - W2{Sn-l) - \wi{Sn) - Wi{Sn-l)\) < 4| Wi (s„) - Wi (s„_i) | . 

This implies the desired estimate. 

Lemma 6.14. Let 5 > 2. Then, under the conditions stated above, 

™ ^0 as n ^ oo in Pq -probability. 



□ 



max ■ 

l<m<n 



a{n) 



Proof. For every e > 0, 



max > e 

l<m<n 



ain) 



< 



< 



l-{l-Po[X^,-Xr, >ea{n)]r 
2Ci 



1 



1 



{ea{n)Y 



as n — )• oo. 



□ 



By Theorem r6. 11 1 we obtain (a(n)) ^{X[n.]+Ti - v[n-] - X^-J =^ /U '^/^Y{-) as n oo. 
Since ri is a.s. finite and X moves in unit steps, we conclude that 

-v[n-] Ml 



a(n) 



Parts (iii) and (iv) of Theorem 16.51 identify the one-dimensional distribution of the 
limiting stable process. If (5 = 4 the process y is a constant multiple of the standard 
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Brownian motion and, therefore, is continuous. By (6.6), for this case we can replace 
Ml- with Ji-convergence. This completes the proof of Theorem 16.71 □ 

Finally we quote a functional limit theorem in a different spirit, which can be found 
in |RS] . Here P is not fixed but scaled as well. Roughly speaking, the cookies are being 
diluted, becoming more and more like placebo cookies while the total drift stored in a 
cookie stack remains the same. 

Theorem 6.15. {d = 1, excited Brownian motion as limit of ERW [RSj Th. 1.4]) 

Assume that : M — )■ M is Lipschitz continuous and bounded by some finite constant C. 
Define for all k > C,k €zN, a spatially homogeneous environment £ Q by setting for 
all z €Z,i £ N, 

UJk{z, l,i) = 1- UJk{z, -l,i) = i ^1 + 

and let (^fc,n)n>o o,"^ ERW in the deterministic environment ujk- Furthermore, let 
{Y{t))t>Q be the solution, called excited Brownian motion, to the stochastic differential 
equation 

dY{t) = dB{t) + ip{L{t, Y{t))) dt, Yo = 0, 
where L is the local time process ofY. Then as k ^ oo, 

2k ^ '' 

6.2. Results for d > 1. The law of large numbers considered in Theorem 15.91 can be 
complemented by an averaged central limit theorem. 

Theorem 6.16. (d > 2, convergence to Brownian motion jBROTl Th. 1 (ii)], 
|MPRV[ Th. 1.2 (ii)]) Let £ G M''\{0} and assume (MPRV^), (IID) and (UEL). Then 
there exists a non- degenerate d x d matrix G such that with respect to Pq, 

X\n-] - [n-]v Ji „ . . ^ 

Bey) as n ^ oo. 



/n 

where Bq is the d-dimensional Brownian motion with covariance matrix G. 

A central limit theorem in the original model (BW) was also obtained in [HH12t Th. 
2.2] by the expansion technique mentioned in Remarks I4.11l and l5.101 

Problem and Example 6.17. {d > 1, quenched CLT) Find measures P (not includ- 
ing those which model RWRE) such that for P-almost all uj the distribution under Po.oj 
of Tn or Xn, properly centered and normalized as needed, converges weakly to some 
non-degenerate distribution as n — )• oo. 

(a) Here is a somewhat degenerate example for d = I: Assume (IID), := E[cj(0, 1, 1) 
u;(0, -1, 1)] > and let P-a.s. a;(0, l,i) = I for i £ {2,3}. It is not difficult to see that 
for P-almost all lo the random variables := T^+i — Tf^, k >0, are independent under 
Po,u} with PQ^i^[Ak = 1] = uj{k, 1,1) and Po^uii^k = 3] = uj{k,— 1,1) for k > 1 and 
Po,oj[Ti = 2j + 1] = uj{-j, 1, l )Ui=l<^ i-k, -1, 1) for j G Nq. By the Lindeberg-Feller 
central limit theorem (see e.g. jPurlOl Th. 3.4.5] with Xn,k '■= {^k — Eo,uj[^k]) / V^) we 
have P-a.s. the following convergence in Po,aj-distribution: 

Tn - ^ z as n ^ oo, where Z~AA(0,1). 
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Note that here the centering is random, i.e. depends on u. 

(b) Consider measures P under which not only the stacks of cookies are i.i.d. hke 
in (IID) but also the cookies within the stacks, i.e. under which the 2d-valued vectors 
oj{z, ■,i),z G G N, are i.i.d.. Obviously, under the averaged measure Pq this ERW 
has the same distribution as a standard RW with i.i.d. increments distributed according 
to (E[(a;(x, e, z)])e6£ and thus satisfies a central limit theorem, unless in degenerate 
cases. Nevertheless it is not obvious that the distribution of X under Px^ca satisfies for 
P-almost all to a central limit theorem as well. A similar problem has been intensively 
studied in the setting of RWs in space-time random environments, see e.g. [DL09| and 
the references therein. The difference between this well-established model and the new 
model proposed here is that in the new model the transition probabilities would not 
depend on the absolute time but on the local time. 

7. Further limit theorems 

In |Ras04] a large deviation principle for a large class of self-interacting RWs on 
Z'^,d>l, including some ERWs, is proved. A stronger result for ERWs in the setting 
discussed in Section [L3t whose proof uses branching processes, is given in |Petl2j . 

Theorem 7.1. {d = 1, large deviation principle under the averaged measure 
|Ras04j . [Petl2j ) Assume (IID), (BD) and (WEL). Then there is a continuous, convex 
function I : [—1, 1] — )• [0, oo) such that for any Borel set B C [—1, 1]^ 



inf I{x) < liminf Pq 



n 



< limsupPo 



n 



< - inf I{x), 



where B° denotes the interior and B the closure of B. Moreover, if 6 > 2 and v denotes 
the speed of the walk then I{x) = for all x G [0,f]. More precisely, for all x G (0,^), 

logPo[^n/n < x] 6 
lim = 1 . 

n-i-oo log n 2 

For further properties of the rate function / see |Petl21 Lem. 5.1]. 
The maximum local time of transient ERW under the conditions of Section 11.31 is 
considered in [RR| . In particular, the following is shown. 

Theorem 7.2. {d = 1, maximum local time |RR1 Th. 1.2 (ii), Cor. 1.4]) 
Assume (IID), (BD) and (WEL) and let 5 > 1. Denote by ^* := maxx£zi^{i G 
{0, I Xi = n} the largest number of visits to a single site by time n. Then 

PQ-a.s. for all a > 1/6, 

^* (logn)° C 
lim , " ^ = and lim , ,^^ " = oo. 

n^oon^/{^^^) (logn)° n->oo n^K^^o) 

Thus {^n)n>o behaves in the non-ballistic transient regime 5 G (1,2] similarly to its 
counterpart for the simple symmetric RW whereas in the ballistic regime 6 > 2 the exact 
value of 6 plays an important role. The proof uses branching processes. 
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